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ABSTRACT 


This  paper  studies  tfrs  model  of  superimposed  exponential  signals  in 
noise: 


V‘> 


■  l 


k=l 


akjXk  + 


t  *  0,1 o . >n-l ,  J  —  l,o»o, N 

jL.ro  ^-r' 


where  are  unknown  complex  parameters  with  module  1, 

are  unknown  complex  parameters  with  module  less  than  1,  X^,...,v  are 


assumed  distinct,  p  assumed  known  and  q  unknown. 


akj*  k_1 . p’  J’  =  1 . 


are  unknown  complex  parameters.  e.(t),  t  =  0,1,..., n-1,  j  =  1,...,N,  are 

J  / 

j  i  .  , 

i.i.d.  complex  random  noise  variables  such  that 

Ee^U),'  E|ei(0)  I2  =  62,  0  <  62  <  »,  E|  ei(0)  l4  < 

2 

and  a  is  unknown.  This  paper  gives: 

1.  A  strong  consistent  estimate  of  q; 

p 

2.  Strong  consistent  estimates  of  Xj,...,x  ,  6  and  | | ,  k  <^q; 

3.  Limiting  distributions  for  some  of  these  estimates; 

4.  A  proof  of  non-existence  of  consistent  estimates  for  x^  and  a^.,  k 

5.  A  discussion  of  the  case  that  N  -*•  «. 
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ASYMPTOTIC  PROPERTY  OF  THE  EVLP  ESTIMATION  FOR 
SUPERIMPOSED  EXPONENTIAL  SIGNALS  IN  NOISE 


Z.  D.  Bai,  X.  R.  Chen,  P.  R.  Krishnaiah  and  L.  C.  Zhao 


1.  INTRODUCTION 


Consider  the  model 


Yj(t)  *  J1akjxk  +  e0(t>- 


t-0,l,...,n-l,  j-1 ,2 . N 


(1.1) 


where  xA,...,x  areunknown  complex  parameters  with  module  not  greater  than 
one,  and  are  assumed  distinct  from  each  other,  akj.,  k=l,2,...,p,  j=l,2,...,N, 
are  unknown  complex  parameters,  e.(t),  t=0,l,... ,n-l,  j=l,...,N,  are  iid. 

J 


complex  random  noise  variables  such  that 


Ee^O)  =  0,  Ee(0)eJW  =  a  ,  0  <  a  < 

Ele1(0) |4  < 


(1.2) 

(1.3) 


where  a  is  unknown.  Throughout  this  paper,  i=/^T,  ft,A'  and  A*  denote  the 
complex  conjugate,  the  transpose  and  the  complex  conjugate  of  the  transpose  of 
a  matrix  A  respectively. 

The  model  (1.1)  can  be  viewed  either  as  an  ordinary  time  series  (single¬ 
experiment  for  N=l,  multiple-experiment  for  N>1)  with  uniform  sampling,  or  as 
a  model  for  a  linear  uniform  narrow-band  array  with  multiple  plane  waves 

present,  and  each  measurement  vector  (the  "snapshort")  Y.  =  (Y.(0) ,. . . ,Y .(n-1 ) ) 

*  J  J  J 

represents  the  output  from  n  individual  sensors. 


At  *%**** 


The  primary  interest  in  this  model  is  to  estimate  the  parameter  vector 


A  =  (a,,..., A  )'  based  on  the  data  {Y.,j=l,...,N}.  In  some  investigations, 

m  ^  r  J 

for  example  [1],  [2]  and  [3],  it  is  assumed  that  the  vector  a^  =  (a^.a^, 
...,a  j  =  1 . N,  are  i id.  random  vectors  with  a  common  mean  vector 

r  J 

zero  and  covariance  matrix  R  =  Ea.a.*.  In  other  studies,  for  example  [4],  it 

**  J**  J 

is  assumed  that  akj. ,  the  complex  amplitude  of  the  k-th  signal  in  the  j-th 

snapshort,  is  simply  an  unknown  constant,  and  it  is  desired  to  estimate  these 
constants  based  on  the  data.  We  shall  adopt  the  latter  assumption  in  this 
paper. 

Various  methods  for  estimating  the  parameters  A  and  a.'s  are  proposed 

-  -  J 

in  the  literature.  If  A  were  known,  the  least  squares  (LS)  method  would 

mm 

give  the  following  estimate  of  a-: 

•  J 

3j  -  (A*(a)A(a))"1A*(a)Y.,  j  =  1,2 . N,  (1.4) 

where 


From  this  consideration,  some  authors  suggested  that,  after  obtaining  some 

A  A 

estimate  A  of  A,  one  substitutes  A  for  A  in  (1.4)  to  yield  an  estimate  of 
a..  For  estimation  of  A,  Bresler  and  Macovski  [4]  derived  the  maximum 

-j 

likelihood  (ML)  criterion  under  the  normality  assumption  on  (e.(t)},  which  is 

J 


3 


just  the  LS  criterion.  Other  methods  are  proposed  such  as  that  of  Prony, 
Pisarenko  and  modifications  thereof  (e.g.  [5],  [6],  [7],  [8]).  .Not  much 
is  known  about  the  statistical  properties  of  these  estimates.  For  some 
results  in  this  respect,  the  reader  is  referred  to  Bai,  Krishnaiah  and  Zhao 

I 

[9].  They  considered  the  case  where  N=1  and  x^s  are  all  of  module  one, 

suggested  an  equivariation  linear  prediction  (EVLP)  method  to  detect  the  number 

2 

p  of  signals,  and  to  estimate  X  and  o  .  They  established  the  strong  con¬ 
sistency  of  the  detection  criterion  and  estimators,  and  obtained  the  limiting 
distributions  of  related  estimators.  Analysis  and  comparison  for  some 
estimates  of x are  also  made. 

In  this  paper,  we  apply  the  EVLP  method  to  the  general  model  (1.1). 

This  method  is  a  modification  of  a  classical  method  dating  back  to  Prony  [10]. 
As  pointed  out  by  Rao  [11],  the  Prony  method,  which  features  in  minimizing 
certain  quadratic  form  of  the  observations,  ignores  the  correlation  of 
related  linear  forms  therein,  and  the  consistency  of  the  related  estimates 
is  in  doubt. 

Roughly,  the  EVLP  method  can  be  described  as  follows:  Consider  the 

i 

i  set 

P  o 

Bp  =  (b  =  (b0,...,b  )':J  | bjJ  =  1,  b^O,  ^.....b  j  complex).  (1.5) 

k— 0 

Define  a  function  Qp(b)  as  follows: 

,  N  n-l-p 

V-1  =  fmrrr  ^  ti# 

A 

We  can  find  a  vector  b6Bn  such  that 

-  P 

Qn  A  Q  (b)  =  min{Q  (b):bSB  }  (1.7) 


k=0 


bkY.(t+k)| 


bCBp. 


(1.6) 


Let  Aj , . . . ,Ap  be  the  roots  of  the  equation 

l  b.z^  =  0.  (1.8) 

k=0  K 

A 

Then  a k  is  taken  as  an  estimate  of  xk,  k=l,...,p. 

For  considering  the  asymptotic  properties  of  the  estimates,  we  shall 
distinguish  the  following  two  cases: 

Case  (i):  N  is  fixed  and  n  tends  to  infinity; 

Case  (ii):  n  is  fixed  and  N  tends  to  infinity. 

First,  consider  case  (i).  Put 

A  =  {k:  |Ak|  =  1,  l<k<p.},  ac  =  (k:  |xk|<lf  Uk<p}.  (1.9) 

Without  loss  of  generality,  we  can  assume  that 

A  *  {1,2,... ,q>  for  some  q  <  p.  (1.9)' 

We  shall  show  in  the  sequel  that  there  will  be  no  consistent  estimate  for 
xk,  kCAC,  when  AC  f  $  (c.f.  Theorem  4.1),  and  if  ac  ^  <fr,  the  above 

procedure  fails  to  provide  consistent  estimates  for  Aj,...,Aq  (c.f.  Remark 

3.1).  In  view  of  this,  it  is  important  to  seek  for  a  consistent  estimate 

A 

q  of  q  4  #(A).  This  enables  us  to  use  q  to  replace  p  in  procedure  (1.5)- 
(1.8)  to  obtain  estimates  of  A^,...,Aq. 

A  I 

Having  obtained  estimate  A  of  A,  estimates  of  a  .s  can  be  obtained  by 

A 

replacing  a  by  a,  as  mentioned  earlier.  At  a  first  look  it  would  suggest 
••  •» 

A 

that  the  estimates  of  a j 1 s  so  obtained  should  be  consistent  when  a  is  a 

consistent  estimate  of  x.  In  fact,  this  is  not  true.  The  reason  is  that 
in  order  to  get  consistent  estimates  of  a^.'s  by  this  method,  Ak  -  Ak  should 


5 


A 

be  of  the  order  Op(l)  for  r  <_  n  -  1.  But  usually  x^  -  x^  is  only  of 


the 


order  0  (l//n),  and  x£"*  -  x^"*  cannot  have  the  order  o  (1).  However,  it  is 


p'~'  ' '  — "  k  k  -  -  -  ’p 

possible  to  estimate  ja^l  consistently,  where  k=l,2,...,q,  j=l,2,...,N. 


In  section  2,  we  give  a  detection  procedure  for  q,  and  give  some 
2 


estimates  of  x^,  a  and  |akj.j  for  k=l,...,q  and  j=l,2,...,N.  In  section  3, 

we  establish  the  strong  consistency  of  these  procedures,  and  find  the  limiting 
distributions  for  some  estimates.  In  section  4,  we  show  the  non-existence 
of  consistent  estimates  for  x^  and  a^j,  where  k=q+l,...,p,  j=l,...,N. 

Finally,  section  5  is  devoted  to  a  brief  discussion  of  case  (ii). 

The  strong  consistency  of  the  LS  estimation  of  X^,  k6A,  shall  be 

established  in  a  forth-coming  paper  [12]. 


6 


2.  DETECTION  AND  ESTIMATION  PROCEDURES 
In  this  section,  it  is  desired  to  determine  q=#(A),  and  to  estimate 
Ak,  a2  and  | a k j | ,  k=l,2,...,q,  j=l,2,...,N  (refer  to  (1.9)  and  (1.9)'). 

Throughout  this  section,  N  is  fixed  and  n  tends  to  infinity,  and  the 
following  conditions  are  assumed: 

Aj^l »  k=l  ,2,.. .  ,q;  ^k^£  k^-Cjkj'C3!,...  ,q,  (2.1) 


N  i  I 


0  for  k=l,2,...,q. 


(2.2) 


For  detection  problem,  we  also  assume  that  (1.2)  and  (1.3)  are  satisfied. 


For  r=0,l,2,.o.,p,  define  a  set  of  complex  vectors 

Br  *[b(r)  =  (b<r>,...,b<r>),:b<r)  >  0.  and  jjbj 


f  r*  ^ 

and  a  quadric  form  of  bv  '  : 


(2.3) 


?  V'"  ?  K(r)v  2  h(r) 


W  l  l  J  rtbk  Yj(t+k) 

r  r)  j=l  t=o  k=  0  K  J 


,  bv,/6Br.  (2.4) 


Qr  =  min  |Qr(b(r)),  b(r)6Brj. 
Choose  constant  Cn  satisfying  the  following  conditions: 


(2.5) 


lim  Cn  =  0,  lim  /n  Cn/ 
n-x»  n-x» 


(2.6) 


Then  we  find  the  nonnegative  integer  q  <_  p  minimizing 

I(r)  =  Qr  +  rCp,  r-0,1 ,. . . ,p , 


(2.7) 


and  use  q  as  an  estimate  of  q. 


Note  that  if  bv‘ ;  =  (b^1  ' ,. ..  ,b^‘  ') 1  satisfies 


N  n-l-rl  r 


Qr  =  NrfPT  l  l  l  bk  Y,(t+k) 

r  mn  r;  .  j  t=Q  k=Q  K  J 


then  is  the  smallest  eigenvalue  of  the  matrix 


?tr)  -  Off).  1. m-0,l....,r, 


:<r)  < 


and  bv  '  is  the  corresponding  eigenvector,  where 


*(r)  = 
Yfm  N( 


N  n-l-r 


1  l  Y.(t+£)Y,(t+m),  -f ,m=0»l »« . .  ,r. 
n  r)  j=l  t=o  J  J 


(2.8) 


Put  =  exp(io)k)  for  k=l,...,q.  As  shown  in  section  3,  with  probability 

A 

one,  we  have  q=q  for  n  large.  Hence,  to  estimate  w 1 ,... ,w  ,  without  loss 
of  generality,  we  can  assume  that  q=#( A)  is  known.  For  simplicity  we  write 

A(q)  A  *  l  Q)  *  AAA  A 

rVM  -r,  etc.  Let  b=(bQ  ..  ,bq) 1  GB^  be  a  eigenvector  of  r 

associated  with  its  smallest  eigenvalue.  Under  the  conditions  (1.2),  (2.1) 
and  (2.2),  it  can  be  shown  that  with  probability  one  for  n  large,  the  equation 


B(z)  A  I  b.zk  =  0 


(2.9) 


A  A  A 

has  q  roots,  namely  pk  exp(io^),  k=l,2,...,q,  where  pk  >_  0,  wkC(0,2ir),  k  <_  q. 


Further,  Qq  furnishes  an  estimate  of  a 


A 

estimate  I  a  k .  | ,  k=l,...,q,  j=l . N,  write  Ak  =  exp(iwk),  k=l,...,q. 


and  write  approximately  (1.1)  as 


Y .  (t+0) 
J 

Yj(t+1) 


Y . (t+q-1 
J 


a  1  j  X 1 
32jA2 


a*  a* 

qj  q 


6j(t+0) 


ej  (t+q-1 ) 


(2.10) 


r  '  j-  j -  *  *  j- 


Put  =  M  =  (u^).  £,m=l,2,...,q.  Motivated  by  (2.10),  we  propose  the 
following  estimate  of  |a,.|  ,  k  <_q,  j  _<  N: 


TJi 


where  for  any  real  x, 


'•  ■  t: 


i f  x >0 , 
if  x<0. 


Remark  2.1.  If  we  consider  the  more  general  model 


Mt)  =  + 


akjxk  +  ej(t) 


t=0,l,.o. ,n-l,  j=l,...,N, 

where  a  .  is  an  unknown  constant,  X^l,  for  k^£,  k,£=l,...,q.  We  can 


use  a. 


1 1—  x 

.  =  1  Y.(t)/n  t0  estimate  a  ..  Then  the  above  procedures  of 

J  t=o  J  0J 


detection  and  estimation  can  be  used  with  Y j ( t )  replaced  by  Yj(t)  -  a^.. 


3.  ASYMPTOTIC  BEHAVIOUR  OF  THE  DETECTION  AND  ESTIMATION 


In  this  section,  we  establish  the  strong  consistency  of  the  detection 
and  estimation  procedures  proposed  in  section  2.  The  asymptotic  normality  of 
some  estimates  is  also  established.  Throughout  this  section,  N  is  fixed  and 
n  tends  to  infinity. 

Some  known  results  are  needed  in  the  following  discussion.  For 
convenience  of  reference,  we  state  these  as  lemmas. 

LEMMA  3.1.  Let  (Xn,n>l}  be  a  sequence  of  independent  real  random 

00 

variables  such  that  In=lE!Xn^  <  “‘  ^en  ^  Xn  conver9es  a.s. 

Refer  to  Stout([13],  1974,  p„94). 

LEMMA  3. 2. (Petrov).  Let  tXn ,n>_l>  be  a  sequence  of  independent  real 

p  2 

random  variables  with  zero  means.  Write  =  Ij-^EXj  and  Sn  =  Ij^Xj.  If 

lim  inf  B^/n  >  0 
n-**> 

and 

E!xj  |2+6  1  K  <  Oil 

for  some  constants  K  and  6  >0,  then 

lim  sup  Sn/(2B^log  log  B^)*^  =  1  a.s. 
n-*=°  ' 

For  a  proof,  the  reader  is  referred  to  Petrove  ([14],  p.306)  alnd  Stbut 
([13],  p.274). 

LEMMA  3.3.  Let  A  =  (a.k)  and  B  =  (bjk)  be  two  Hermitian  p*p  matrices 
with  spectrum  decompositions 


10 


A  =  J  6k-ki!k  »  S1-S2-  •••  - 

k“l 


and 


xk-k-k’  X1  1  x2  1  •••  1  V 


Further,  we  assume  that 


Vl+1  =  *'*  =  \  =  Xf1’  n0=0<  nl  <**,<  "s  =  P’ 


X1  >  X2  >  *  *  *  >  xs> 

and  that 

!ajk  “  bjk'  <  *•  j»k=1»2 . . 

Then  there  is  a  constant  C  independent  of  a,  such  that 

(i)  ~  A^ |  <  Co,  k-1  . .  ,p, 

(ii)  y  u,,u*  *  T  v,.v*  +  with 


l  ukuU  L 

C=nh-1+1  "  ~  k=nh-l+1 


G^  *  1 9  j  k^  I  —  Cci*  j»k=1»****P»  h=1^ 


Refer  to  [15]. 


LEMMA  3.4.  Let  {Xn,n>l}  be.a  sequence  of  iid.  real  random  variables 

2 

such  that  EX1  =  0  and  EX^  <®.  Let  { ap^}  be  a  double  sequence  of  real  numbers 
such  that 

|ank|  <_  K  k’1^  for  all  k>l,  n>l, 
and 

ank  -  k  n"a  for  a11  n-1, 
where  o>0  and  K<®  are  constants.  Then  we  have 


Refer  to  Stout  ([13],  p .2 31 . ) 

LEMMA  3.5.  Let  9n(x)  be  a  sequence  of  K-degree  polynomials  with 

roots  x["> . x<n>  for  each  n,  and  let  g(x)  be  a  k-degree  polynomials 

with  roots  Xp...,x^,  k<K.  If  9n(x)  g(x)  as  n-*»,  then  after  suitable 
rearrangement  of  x|n^,...,x^n\  we  have  xjn^  +  Xj,  j=l,2,...,k 
and  |x<">|  j=k+l,...,K. 

See  Bai  ([16]). 

THEOREM  3.1.  Suppose  that  in  the  model  (1.1),  the  conditions  (1.2) 
(1.3),  (2.1)  and  (2.2)  are  satisfied.  Then 


1 im  q  *  q  a.s« 

rv+oo 


Proof .  Assume  that  q  =  #(a),  p=  max  | x.  |  <  1,  and  max{|a..|,  l<k<p, 

q<k<p  K  xj  - 


j*l,2,...,N)  =  K.  Under  the  model  (1.1), 

N  n-l-r 


1 


N  n-l-r 

TirTi:Fy  Jl  t=0 


k=l 


„  t+m 


Xk  akj  +  ej(t4lll) 


where  f,  m=0,l,...,r,  r=0,l,...*p.  We  have 


N 


N(n-r) 


j  =1 


n-l-r  P 

t  l 

t=0  k=q+l  k  kj 


k=l  k  kj 


l 


k=q+l 


k  “kj 


,2,2 


—  TT^F^ p_q ^pt^0  pt  -  (n-r)(l-p)  =  °0*  f,m=0,l,...,r.  ( 


By  Lemma  3.1,  It=0  p  I (t-Hn)  |  converges  a.s.. 


N  n-l-r 


u,  -1— t|  l  l  l  xj+£a.  .  e.(t+m) 

tio  kig+l  k  kJ  3 
Ji  tlo  pt|ej(t+m)l  =0(")  a-s- 


By  (3.1)  -  (3.3),  with  probability  one  we  have 


W  - 1  ^ 

♦  !  if*  I  5kj  &  Tr  If  ej(t4 

k=l  k  N  j=l  J  \  t=0  J 


9  m-l  1  S  (j_ny1‘r  x^iTt+Z)! 
A  k  w  j-l  kj  \  n-r  tio  k  1 

*  HT1PFT  j,  "fo  f  +  °  (W> 


*  J1  +  J2n  +  J3n  +  J4n  +  J5n  +  0(n)o 
Write  a.  *  exp(iw.),  w.G(o,2tt),  k=l,2,„.. ,q.  Since tor  kfl, 


we  have 


By  Lemma  3.2, 


J3n  * 


log  log  n 
n  i 


J2n  =  °#' 


a-s.,  JAn  =  0\ 


log  log  n 


By  the  law  of  the  iterated  logarithm  of  M-dependence  sequence, 


|  ,  for  If m. 


o+( y  /log  log  n 


,  for  £=m, 


1  1  .  .  .  1 


/  A1  A2  ‘  ‘  Aq 

n(r)  J  a2  A2  A2 

mn  1  2  •  •  •  Aq 


^r+1) Xq 


A  -  diag[£  . j  JjlOqjl2] 


51J2  '  •  •  V  r<r)  -  °2Ir+1  +  n(rWr>’ 


Then,  by  (3.4)-(3.8)  we  have 


f(r)  •  r<r>  ♦  fli/MASS.")  a.s. 

Let  ejr^  >_  ...  >_  and  e|r^  >_  ...  >_  ej,^j  be  the  eigenvalues  of 


r'  ;  respectively.  By  Lemma  3.3, 


;(f)  =  ej>>  ♦  ji^ylkioajl)  a.s.,  k-1 . r+l. 

frl  (r)* 

Since  rank  (nv  'An'  '  )  =  min(r+l,q),  we  have 


(rl  2 

e^,+{  >o  for  r  <  q. 


e{r)  =  o2 
6  r+l  0 


for  r  >  q. 


A(r\ 

Since  Qr  =  ej.+j,  we  get 


f  rl  2 

lim  Qr  =  >  o  ,  a.s.,  for  r  <  q. 


lQr  -  o  I  =  0( 


log  log  n 


)  a.s.  for  r  >  q. 


•-  --  ' .-..va  ■'.v.v.v.'v a  ■  ’  '  ' 


From  (2.6),  (2.7),  (3.12)  and  (3.13),  it  is  easily  shown  that,  with 
probability  one  for  n  large, 


Rq  <  Rr  for  r  ^  q»  rSP« 


and,  by  the  definition  of  q, 

q  “  q. 

The  theorem  3.1  is  proved. 

In  the  sequel  we  assume  that  q  is  known.  For  simplicity,  we  write 
?(q)  -  ?.  $>  -  V  £(q)  -  fi.  n(q)  *  o.  etc. 


THEOREM  3.2.  Suppose  that  in  the  model  (1.1),  the  conditions  (1.2), 
(2.1)  and  (2.2)  are  satisfied.  Then,  for  appropriate  ordering,  we  have 


lim  ~  a.s. ,  k~l,2,...,q, 


rH-® 


and 


lim  Q  =  a  a.s. 
n-H»  q 


Proof.  Under  the  conditions  of  the  theorem,  (3.2)-(3.5)  still  hold. 
By  Lemma  3.4, 

^  0,  for  If m, 

a.s. 


lim  J 
n-*=° 


4°- 

5n  j , 


for  If m, 
oc  for  l- m. 


It  follows  that 


lim  r  ■  r(=  j  I  j-kiAo*)  a.s. 

n-x»  1 


Define 


q 

n 

^  k-1 


B(z)  ibn  n  (z-xk)  ibQ+  bjz  +  ...  +  b  z 


(3 


(3 


such  that  b  >  0  and  |bk|^  *  1.  Then  b  =  (b0,...,b  )'  GBq  and 


k=o 


jj 


Let  >_  ...  >.  6q+j  and  0^  0q+^  be  the  eigenvalues  of  r  and  r 

respectively.  Since  rank  (nAn*)  =  q,  we  have 


el  >  ...  >  0q  >  0q+1(=o  ). 


(3.17 


By  (3.16)  and  (3.17),  b  is  the  unit  eigenvector  of  r  associated  with  the 
unique  smallest  eigenvalue  of  r.  Now  b  =  (bQ,. .. ,bq) *€Bq  is  the  unit 

A 

eigenvector  of  r  associated  with  its  smallest  eigenvalue  Qq.  Using  Lemma  3.3 
and  (3.14) ,  we  get 


lim  b  =  b  a.s„,  and  lim  Q  *  a  a.s. 


(3.18 


By  Lemma  3.5,  for  appropriate  ordering,  we  have 

lim  pk  exp(i^k)  =  expfl^)  a.s.,  k-1,2 . . 


which  implies  that 


lim  pk  =  1  a.s.  and  lim  uk  =  «k  a.s.,  k=l,2,...,q. 


Theorem  3.2  is  proved. 

THEOREM  3.3.  If  (1.2),  (2.1)  and  (2.2)  hold,  then 
2  2 

lim  |ak1l  =  I a.. |  a.s.  for  k=l . .  j=l . N. 


Proof.  By  the  theorem  3.2, 


lim  *k  =  xk  a.s.,  k=l,...,q, 


Define 


*»*  *  J  * 

"L  *.  k  V  \  A 


M  ■  {,*)  - 


Then  we  have 


which  implies  that 


q-i  q-1  q-ly 
1  *2  q  / 


"*■  9oS.»  l,m  l,...,q. 


""  “Mxm' 


I  T  1,  k=m, 

=  6km  =  n  .  .  a‘s* 
LO,  k^m. 


By  (1.1),  ( 3„ 19)  and  (3.20),  for  k=l,...,q  we  have 


MX  vr*-1*  •,<«-”) 

,  n-q  p  q  p 

■  — JL_  T  I  >  «. -a  -a  f  >  7  la  .1.0(1) 

t=0  m=l  km  mJ  m  £=1  m=l  mJ 

t  ^klQ3{t+l'l)  +  J1lej(t+£-1)[*o( 

a .  s .  i  n-q  i  .  q 

■  Tf4?T  tl0hA  *  0(1>  +  jj  "Uej(ttM)  + 

t  ?  (lej(tU-l)l2  +  lejIW-DlJ.od) 


r*  umumv  w 
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If 


-  I..,**  I 


kj  k  Mk{  j 


(3.21) 


By  the  SLLN, 


i,Uu  "  iiluw'2  2 


a  a.s. 


(3.22) 


ill  n=q+T  f0(lej(t+£-1)|2  +  lej(t+^-l)| )  »  a 2  +  E|ei(o)|,  a.s. 
n_~  "  *  (3.23) 


By  Lemma  3.4, 


1  n;q  t  9 

n-q+1  £  aki^k  ^  wk£ei (t+£-l ) 

n-~  q  1  t=0  KJ  K  .£=1  ^  J 

=  jl  Vw  li!  ^  X  Xkej(t+<M)  *  0  a-s- 


(3.24) 


By  (3.21)— (3.24) , 


n4+r  t^o  Jl“wVj(t+t’l)|2  =  |akJ|2  +  XWu]Z°Z’  a-s-(3-25) 

From  (2.11),  (3.18),  (3.19)  and  (3,25),  the  theorem  3.3  follows. 

Remark  3.1.  If  q  <  p  and  we  estimate  using  (1.5)-(1.8) 

directly,  then  we  have 

lim  a  a.s. 

n-M» 

ejP^  1  •••  1  0qP^  >  9qP]  =  •••  a  9q+i  (=<j2)  are  the  eigenvalues  of  r^. 


All  eigenvectors  of  associated  with  a2  consist  of  a  (p-q)  dimension  sub¬ 
space.  Assume  that  €  B  such  that 

*•  P 

QD(b(p))  =  min  (Q  (b(p))  :  b(p)  6  B_>, 
p  -  P  -  -  p 


then  bVK/  is  the  eigenvector  of  associated  with  the  smallest  eigenvalue 

of  r^.  We  do  not  know  whether  converges.  In  general,  we  do  not  know 

whether  there  are  q  roots  among  all  roots  of  ££  b^'  2  which  tend  to 

{ ^ k *  k-1,2,...  ,q}. 

Remark  3.2.  Suppose  that  in  the  model  (2.12),  the  condition  (1.2)  hold. 
n-1 

Then  a  .  =  £  Y.(t)/n  is  a  strongly  consistent  estimate  of  a  ..  For  those 

OJ  t=0  J  OJ 

procedures  of  detection  and  estimation  discussed  in  Remark  2.1,  Theorem  3.1  - 
3.3  are  also  true. 

A 

Finally,  we  establish  the  asymptotic  normality  of  and  (0^,  k=l ,2 , . . . , 

To  this  end,  we  assume  that  under  the  model  (1.1),  the  conditions  (2.1), 

(2.2)  are  satisfied,  and  e,(t),  j=l ,2 , . . . ,N ,  t=0,l ,. . . ,n-l ,  are  iid. 

J 

complex  variables,  e-{t)  =  e^t)  +  iej2(t)  and  ej2(t)  are  both  real 
numbers,  which  satisfy  the  following  conditions. 

Eej(t)  =  0  Ee^t)2  =  Eej2(t)2  =  1/2  a2, 

Ee . , (t)e .„(t)  =  0  and  Var( I e •  (t) |2 )  =  with  a>o.  (3.2 C 

J  A  J  ^  J 


u0  U| 


U|  ^ 


■  U ,  UIV 


where  un,u, ,...,u  are  independent,  and 
U  1  q 

(i)  uQ  **  Nr(o,aa4), 


Here  Nc,  Nr  denote  complex  and  real  normal  distribution  respectively. 


Define  b  =  (b0,b1>...,bq)'  by  (3.15).  Put 


Cn  =  /N(n-q)(Qq-a2) ,  Tnj<  =  /N(n-q') (pR-l) , 

Ank  =  /N(n-q)(^-^k),  k=l  ,2 , . . . ,q , 

I 

In  =  ^Tnl ,0  * • ,Tnq^ '  and  An  =  ^Anl »’ *  *  ,Anq^° 

Wri  te 

B(z)  =  l  bkzk, 
k=o  K 

D(exp(i«))  =  -i^j  B(e1w) 
and 

G  =  diag[D(exp(ia)1)),.o.,D(exp(iU)q))]. 

We  have  the  following 

THEOREM  3.4.  Suppose  that  in  the  model  (1.1),  the  conditions  (2.1) 
(2.2)  and  (3.26)  are  satisfied.  Then  we  have 
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D  * 

=  b  U  b, 

n  _i  -i ,  *  _i  * 

T  +  iA  -*■  G  *A  n)  xsi  u  b, 

—  n  -n  •» 

as  n  -*■  °°0 

Here  we  quote  the  following 

LEW  A  3.6.  Suppose  that  the  condition  (3„26)  holds.  Then 

1  n"l"d  t-.p  _  n 


(3.31) 

(3.32) 


1  V  H,t+£p-rrrnD 
—  I  Xk  lAt+l)  --vk., 

/n-q  t=o  K  J  KJ 


k=l,2,.o.,q,  j=l,2,. „ . ,N,  £=0,1,... ,q, 

—  "f  q(|e.(t+£)|2  -  a2)  S  u  j=l,...,N,  £=0,1,... ,q, 

n-q  t=0  J  ^ 

1  n-l-n  _  n 

-  I  e.(t+£)e.(t+m)  ■>  u»  •  j=l,...,N,  0  <  m  <  £  <  q, 

n-q  t=0  J 


Here  ukjS  and  vkjS  are  independent  of  each  other,  and 


0)  Uq.  .  Nr(0,  aa  ),  j=l,..o,N. 


Oi) 

ukj  -  Nc<°-04>' 

J  k-1 

(iii) 

vkj  -  Nc(0>°2)' 

e  |N,  k-1 

(3.33) 


Refer  to  Lenma  4.1  in  [9]. 

The  proof  of  Theorem  3.4  runs  along  the  line  as  in  the  proof  of  Theorem 
4.1  in  [9],  so  the  details  are  omitted. 

Remark  3,3.  For  the  model  (2.12),  Theorem  3.4  applies  those  estimates 


discussed  in  Remark  2.1. 


J 
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4.  NON-EXISTENCE  OF  CONSISTENT  ESTIMATES  OF 
xk,  k€AC  AND  alt30.,aN  WHEN  AC/4> 


Throughout  this  section,  N  is  fixed  and  n-w=.  For  non-existence  of 
consistent  estimate  of  x^,  k6Ac,  we  have  the  following 

THEOREM  4.1.  Suppose  that  in  the  model  (1.1),  e.(t),  j=l,.„.,N, 

J 

p  ° 

are  iid0,  e.(t)  -  N  (0 ,o  )  with  0  <  and  the 

J  c 

(  l  \ 

parameter  space  of  x  =  (x^ ,. . .  ,Xp) 1  contains  two  points  x-  '  -  (Xj,...,x 

x^k))',  k=l  ,2  such  that  X(1)  f  x(2),|x^k)|  <  1,  k=l,2,  and  \  | a  .  | 2  >  0. 

"  p  j=l  PJ 

Then  no  consistent  estimate  of  x^  exists  as  is  N  fixed  and  n-*«=. 

Proof .  It  suffices  to  show  that  a  consistent  estimate  of  X  cannot 

P 

2 

exist  even  when  {a^}  and  a  are  known.  Hence,  without  loss  of  generality, 
2 

we  assume  o  =  2. 

Introduce  the  prior  distribution  H: 

H(X(1))  =  H(X(2))  =  1/2 


and  the  square  loss  |d-x  [  „  Write 
»  m  N  n-1 


f  =  (2ir)'nNexp{-i  l  l  |  Y.  (t )  -  l  a».  -  (x<k)) 
K  j=l  t=0  J  1= 1  L  p 


pk))‘  k  *  1.2. 


Under  the  above  prior  distribution  and  loss  function,  the  Bayesian  estimate  of 


V  1s 


*p  =  <Vpn  +  f2Jp2)>/,fl+f2> 


Denote  by  R(Xp)  the  Bayesian  risk  of  x  ,  we  have 

"(ip)  i  JEdXp-X^Vlk  =  1) 


r.  f.  ■r.  -7r-.  •r.  W,  -C.  -v-'-y,.  «•„  •*< i\ -'.A.  -f.  -\-r- 


V 
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■4WFH 


p  p  1 


(4.1) 


P-1 


Noticing  that  Yj(t)  -  J  X*a£j  -  =  e^t)  when  k  =  1,  we  have 

log  4  >  -*  l  ni1iapj!2l(^1))t  -  (^2))t|2 
1  j=l  t=0  PJ  P  P 


N  n-1 


l  l  ((x^2))t  -  (x'i;)C)apje.(t)|. 
j=l  t=0  p  P  PJ  J 


P 

( 1 ) \t > 


(4.2) 


Since  |x^j  <  f,  |xj2^|  <  1,  we  have 


11-  l  Bfl«pJl2l(xJ1,)t-(x<2>)t|2< 

j=l  t=0  PJ  p  p 


(4.3) 


Also,  by  Lemma  3.1,  the  second  term  of  the  right  hand  side  of  (4.2)  converges 
with  probability  one  to  a  finite  random  variable.  From  this,  (4.2)  and  (4.3),  it 
follows  that  there  exists  a  positive  constant  K  such  that 

P(f2/fj  >  K|k  =  1)  >  1/2 

for  n  sufficiently  large.  Hence,  form  (4.1)  we  obtain 


R('iP)i7(m)2lxi1)'^2)lZ>0 


(4.4) 


for  n  large. 


But  if  ?n  is  a  consistent  estimate  of  xp,  then  define 


xpU-  1f  K-Xp1)iilv1p2)i 


We  shall  have 


(2) 

-Xp  »  otherwise. 


en  x<k>  for  x  =  x^,  k  =  1,2. 


Since  is  bounded,  by  the  dominated  convergence  theorem,  we  have 


R(en)  =  1/2  E(Un-xp  I  =  x  )+  1/2  E(Un-xp  1  lx  =  x  )  0  (4-5) 

as  n  +  »,  where  R(5n)  is  the  Bayesian  risk  of  cno  But  this  contradicts  (4.4) 

•* 

in  view  of  the  fact  that  A  is  the  Bayesian  estimate  of  A  ,  and  the  theorem 

P  p 

is  proved. 

£ 

For  the  existence  problem  of  a^  =  (a^ , .  ,a  j ) 1  when  A  we  have 
the  following 

THEOREM  4.2.  Suppose  that  in  the  model  (1.1),  e.(t),  j  =  1,...,N, 

J 

2  2 

t  =  0,1,... ,n-l,  are  i id. ,  e-(t)~  N  (0,o  )  with  0  <  a  <  «.  Also,  some 

J  C 

component  of  A,  say  A  ,  has  a  module  less  than  one,  and  A^  /  A^  if  k  ft. 

Then  no  consistent  estimates  can  be  found  for  api>*°*»apN* 

Proof .  As  in  the  proof  of  Theorem  4.1,  we  may  assume  that  Aj,...,A 

and  a^,  k  =  l,„..,p-l,  j  =  1,...,N,  are  known.  Also  without  loss  of 

P— 1  t 

generality  we  may  assume  N  =  1.  Write  Y^(t)  -  \  a^A^  =  X(t),  and  for 

k  1 

simplicity,  write  Ap  =  A,  ap  =  e.  Then  the  model  (1.1)  is  reduced  as  the 


following  linear  model 


X(t)  =  BA1  +  e(t) ,  t  =  0,1  ,.o .  ,n-l ,  (4.6) 

where  A  is  known  and  |a|<  1.  .  It  is  desired  to  show  that  there  is  no 
consistent  estimate  for  p. 

Let  e  denote  the  LS  estimate  of  3.  By  a  theorem  of  Drygas  [17],  the 

A  A 

consistency  of  8  is  equivalent  to  Var(p)  0.  But  from 

b  «  (Ym24)-1  niVx(t), 

't=0  '  t=0 


-  (  l  N2t)_1  l  xtx(t), 

't=0  '  t=0 


•f /An’  *  ' 


var(8)  =  °\i0]xn 


->  0  (1-|X|  )  f  0, 


we  know  that  6  is  not  consistent. 

Since  (e(t)}  ts  a  sequence  of  iid.  variables  with  a  cornnon  normal 
distribution,  it  follows  by  a  theorem  of  Ker-Chan  Li  [18]  that  there  cannot 
exist  any  consistent  estimate  for  b.  The  theorem  4.2  is  proved. 
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5»  THE  CASE  WHERE  n  IS  FIXED  AND  N  -  -. 


In  this  section,  we  assume  that  n  >_  p  +  1  is  fixed  and  N  tends  to  infinity. 
Consider  the  model  (1.1).  Assume  that  x^  f  x ^  if  k  f  t  (note  that  the 

condition  |x^|  =  1  can  be  dropped),  and  that  (1.2)  is  true.  We  can  use  the 

A  I  | 

EVLP  method  described  in  section  1  to  obtain  estimates  x^s  of  x^s  (refer 

to  (1.5)-(1.8)  and  so  on).  We  have  the  following 

THEOREM  5.1.  Suppose  that  under  the  model  (1.1),  x^  f  X^if  k  f  l,  and 

(1.2)  holds.  Also,  n  >  p  +  1  is  fixed  and 


1  N  _  , 

lim  T7  )  a  .a  .  =  f 

15  j=i  -j-j 

exists,  where  aj  =  (ajj »a2j  ,. • ♦ »apj  is  a  pxp  positive  definite 

A  A 

matrix.  Then,  X,,.„.,X  and  CL  are  strongly  consistent  estimates  of 

i  p  p 

2 

*1 »« °  °  »Xp  and  a  . 

Proof.  By  (1.5)-(1.7),  Qp  is  the  smallest  eigenvalue  of  the  matrix 

A  A  A 

r  =  =  0»1»»«=  »P»  an^  b  is  the  corresponding  eigenvector,  where 

1  N  n-l-p  _ 

Ylm  =  N(n-p)  X  ^  Yj(t+f)  Yj(t-Hn),  £,m  =  0,1 , . . . ,p.  (5.1) 


By  (l.i), 


?  1  n;1_P  rt+Lt+m  1  r  - 


,  n-l-p  N 

+  N^pTt?o  j^i  *im)  ej!t4m) 


-  *1N  +  J2N  +  !3N  +  *4N‘ 


(5.2) 


We  have 


N1"1  X1N  "  k  i 
N-*»  k ,  < 


f  A-±V'P  t  t 

k=1  k  K  n"p  t=0  Ak  ^kic  A<  * 


. ,p. (5.3) 


By  Lemma  3.4, 


By  the  SLLN, 


Write 


lim  I_w  =  lim  IOM  =  0  a.s< 
N~>  2N  N-*»  3N 


r4N  =  a  6£m’  a,s°’  = 


(5.4) 


(5.5) 


n 

(p+l)xp 


1  l  ...  1 


X.  X«  .  o .  x 

1  2  p 

-2  -2  -2 

A1  A2  Ap 


xp  xp 

VA1  2 


-  di ag[ X ^ . o . , Xp] , 


(5.6) 


By  (5.2)  -  (5.5) ,  we  have 


where 


lim  r  =  r  a.s. 

N-*«° 


2  1  n^~p  — t  t  * 

r  =  0  'p+l  +  T^p  tlQ  nVV  • 

rn:l-P  f  *\ 


(5.7) 


(5.8) 


/n-I-p  .  .  * \ 

Noticing  that  rank  [  ]  )  =  p,  we  can  finish  the  proof  by  repeating 

't=0  1  1  ' 


the  argument  used  in  the  proof  of  Theorem  3.2. 


r*»r»M  ri 
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